Sparse linear mixed model selection via streamlined variational Bayes
نویسندگان
چکیده
Linear mixed models are a versatile statistical tool to study data by accounting for fixed effects and random from multiple sources of variability. In many situations, large number candidate is available it interest select parsimonious subset those being effectively relevant predicting the response variable. Variational approximations facilitate fast approximate Bayesian inference parameters variety models, including linear models. However, having high or effects, simple application standard variational principles does not lead algorithms, due size model design matrices inefficient treatment sparse matrix problems arising required approximating density updates. We illustrate how recently developed streamlined procedures can be generalized make accurate with nested global-local priors selection. Our algorithms achieve convergence same optima their implementations, although significantly lower computational effort, memory usage time, especially numbers effects. Using simulated real examples, we assess quality automated selection that free hyperparameters tuning only rely upon posterior approximations. Moreover, show accuracy against fitting via Markov Chain Monte Carlo sampling.
منابع مشابه
Variational Bayes via Propositionalization
In this paper, we propose a unified approach to VB (variational Bayes) [1] in symbolicstatistical modeling via propositionalization1. By propositionalization we mean, broadly, expressing and computing probabilistic models such as BNs (Bayesian networks) [2] and PCFGs (probabilistic context free grammars) [3] in terms of propositional logic that considers propositional variables as binary random...
متن کاملFunctional regression via variational Bayes.
We introduce variational Bayes methods for fast approximate inference in functional regression analysis. Both the standard cross-sectional and the increasingly common longitudinal settings are treated. The methodology allows Bayesian functional regression analyses to be conducted without the computational overhead of Monte Carlo methods. Confidence intervals of the model parameters are obtained...
متن کاملHierarchical Model Selection for NGnet Based on Variational Bayes Inference
This article presents a variational Bayes inference for normalized Gaussian network, which is a kind of mixture models of local experts. In order to search for the optimal model structure, we develop a hierarchical model selection method. The performance of our method is evaluated by using function approximation and nonlinear dynamical system identification problems. Our method achieved better ...
متن کاملOnline Model Selection Based on the Variational Bayes
The Bayesian framework provides a principled way of model selection. This framework estimates a probability distribution over an ensemble of models, and the prediction is done by averaging over the ensemble of models. Accordingly, the uncertainty of the models is taken into account, and complex models with more degrees of freedom are penalized. However, integration over model parameters is ofte...
متن کاملModel Selection , Covariance Selection and Bayes Classification via Shrinkage Estimators
Statistics) MODEL SELECTION, COVARIANCE SELECTION AND BAYES CLASSIFICATION VIA SHRINKAGE ESTIMATORS by
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Electronic Journal of Statistics
سال: 2022
ISSN: ['1935-7524']
DOI: https://doi.org/10.1214/22-ejs2063